Bulletin of Electrical Engineering and Informatics 
Vol. 11, No. 4, August 2022, pp. 2187~2195 
ISSN: 2302-9285, DOI: 10.1159 1/eei.v1 114.3806 O 2187 


Crowd evacuation navigation for evasive maneuver of brownian 
based dynamic obstacles using reciprocal velocity obstacles 


Susi Juniastuti', Moch Fachri', Fresy Nugroho’, Supeno Mardi Susiki Nugroho”, Mochamad Hariadi? 
‘Department of Electrical Engineering, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia 
Department of Computer Engineering, Institut Teknologi Sepuluh Nopember, Surabaya, Indonesia 
3Department of Information Technology, Universitas Islam Negeri Maulana Malik Ibrahim, Malang, Indonesia 


Article Info 


ABSTRACT 


Article history: 


Received Mar 14, 2022 
Revised May 15, 2022 
Accepted Jun 8 ,2022 


This paper presents an approach for evasive maneuver against dynamic 
obstacles in multi-agent navigation in a crowd evacuation scenario. Our 
proposed approach is based on reciprocal velocity obstacles (RVO) with a 
different manner to treat the obstacles. We treat all possible hindrances in 
velocity space reciprocally thus all collision cones generated by other agents 


and obstacles are treated in the same RVO manner with the key difference in 
the effort of avoidance. Our approach assumes that dynamic obstacles bear 
no awareness of navigation space unlike agents thus the avoidance effort lies 
on behalf of the mobile agents, creating unmutual effort in an evasive 
maneuver. We display our approach in an evacuation scenario where a 
crowd of agents must navigate through an evacuation area trespassing zone 
filled with dynamic obstacles. These dynamic obstacles consist of random 
motion built based on Brownian motion thus posses an immense challenge 
for the mobile agent in order to overcome this hindrance and safely navigate 
to their evacuation area. Our experimentation shows that 51.1% fewer 
collisions occurred which is denote safer navigation for agents in 
approaching their evacuation point. 
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1. INTRODUCTION 

Navigation of multi-agents in crowd evacuation holds an important key in agent-based model 
evacuation. This agent-based enables a high level of realism since it can model complex human behavior [1]. 
Multi-agent navigation under evacuation conditions is often required to provide necessary maneuvers to 
evade other agents and obstacles that exist on the evacuation route. This maneuver is handled by the agent’s 
motion planning which relies on the agent’s perception of its navigation space. In dealing with motion 
planning for agent navigation, many studies classify this type of planning into global and local planning [2]-[10]. 
Global planning depends heavily on the information of the current navigation plane that the agent currently 
navigating. This information is used for precalculation for path planning which is unsuitable for the dynamic 
environment in evacuation scenarios, where obstacles and agents’ positions are constantly on move [3], [7], 
[10]-[19]. Global planning is only viable as long as the information of navigation space is available for the 
navigating agents. One example in a study about crowd simulation where evacuation path is set [20]. This 
type of planning is also applicable with information retrieved from surveillance [21] or shared through 
communication [22]. Such conditions cannot be fulfilled in a situation where evacuee find their position in 
some unknown environment [23]. Local planning takes information through agent local data while navigating 
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[24]-[31]. This makes the local planning method computationally efficient. The previous study we mention 
utilizes local planning for avoidance purposes against other dynamic objects. It is accomplished by using 
agent interact force based on the social force model. Whereas in uncertain environment issues, since 
information regarding the navigation space can merely be acquired locally, the function of local planning is 
even more critical [23]. An evacuation scenario is one such environment where obstacles are dynamically 
hurdled the evacuees, and other evacuees in such situations may hinder each other. 

Velocity obstacles (VO) is a local motion planning invented for autonomous agents that facilitate 
safe agents’ navigation. VO is able to predict the agents’ velocity that will produce collisions using 
information obtainable from the sensors or other mean [32]. This basic method of VO has received much 
refinement through the years. Several instances to mention are non linear velocity obstacles (NLVO) [33], 
probabilistic velocity obstacles (PVO) [34], improved velocity obstacle (IVO) [35], finite-time velocity 
obstacle (FVO) [36], goal velocity obstacle (GVO) [37], inverse velocity obstacles (IVO) [38], probabilistic 
inverse velocity obstacle (PIVO) [39], and reciprocal velocity obstacles (RVO) [40]. NLVO built upon the 
contemplation of the nonlinear motion that may present in obstacles, it also introduces the notion of risk. The 
notion of risk allocates a value that depicts the risk characteristic to each velocity of the certain agent. The 
velocity that would produce instantaneous collision has more heightened values of risk than other velocities 
inside VO that do not instantly yield a collision in its course. PVO further expands the VO formula for 
uncertain assessment that may occur in sensors data acquisition. PVO consider that the mobile agent’s data 
acquisition in real-life circumstances (e.g mobile robot) is taken from sensors with a particular boundary in 
their capability to thoroughly capture the essential perception of agents against its surrounding. This is since 
noise in sensors assessment may exist. This assembles a probabilistic framework to bridge the agent’s 
perception and navigation for the avoidance purpose. IVO is devised with motion uncertainty of the obstacles 
and built an optimization objective function to enhance motion decisions. It’s split the avoidance approach 
into two major operations, obstacles data processing for threat estimation and avoidance decision. The 
optimization objective function of IVO consists of the following parameters: risk of speed, the target speed 
deviation, and the collision time. FVO introduces time constraints [36]. It optimizes the operation of velocity 
alteration to minimize the avoidance velocity with the adequate velocity for agents to achieve their 
destination. Another extension called GVO brings the region of goal into VO formulation [37]. The goal 
region in GVO is the area of preferred velocities that will lead the agents toward their navigation objective. 
IVO introduces an ego-centric framework [38]. IVO presumes that each agent is the epicenter of the 
avoidance process at egoframe inside VO, thus assuming that the agent is stationary at the point of origin. At 
that assumption, proximate velocity beyond the VO collision cone is picked based on egocentric observation 
of the obstacle at two successive time instances. PIVO is based on IVO merged with PVO that notices 
uncertainty in assessment due to occurring noise. RVO is developed to deal reactive nature of avoidance in 
multiagent navigation and successfully prevent oscillatory motion that occurred during the reactive avoidance 
process [40]. 

The main problem with the existing velocity-based approach we mention lies in the capability of 
handling both reactive collision avoidance within agents and dynamic obstacles situations simultaneously. 
Some approaches were designed for avoidance against obstacles [33]-[37], while others optimized their effort 
against agents [38]-[40]. Using some method for handling obstacles avoidance in conjunction with other 
methods to handle agents avoidance, may break the collision-free properties of their respective methods. For 
the examples, the RVO is ensured to yield collision-free and oscillation-free properties as long as every agent 
makes equal avoidance reasoning [40]. In a crowd evacuation scenario, an agent is challenged not only by 
dynamic hindrances that exist in the environment but also by other agents that attempt to escape alongside. 
Thus, a method that can handle both cases with equally satisfactory performance is demanded. 

In this paper, we presented our method based on RVO in an agent-based crowd evacuation. RVO is 
tasked to handle collision avoidance against agents and Brownian-based dynamic obstacles. Brownian-based 
dynamic obstacles are obstacles that behave erratically based on Brownian motion. Our approach is to treat 
the Brownian-based dynamic obstacles as agents that bear no awareness of its surrounding since they behave 
randomly as obstacles in an evacuation should be, a hindrance for the evacuee. Thus, we proposed different 
formulations in combined RVO used in multi-agent navigation. We proposed a combined reciprocal velocity 
obstacle for the agent as the union of the individual reciprocal velocity obstacles of the other agents including 
the obstacles but with a different value in the effort of avoidance, in contrast to the original RVO concept that 
differentiates VO generated from the agent and obstacles [40]. Mobile agents take the maximum effort of 
avoidance when dealing with Brownian-based dynamic obstacles due to the fact that obstacles cannot 
perform avoidance and serve only as hurdles. We conduct a crowd evacuation scenario filled with Brownian- 
based dynamic obstacles and hundreds of mobile agents to demonstrate the effectiveness of our proposed 
method. 
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2. METHOD 

RVO is a concept based on velocity obstacles that take into account that the avoidance process 
between agents is a reactive process [40]. This method solved the velocity obstacle’s major drawback in 
multi-agent navigation, which is oscillatory motion problems caused by reactive collision avoidance. 
Individually, the agent is expected to be autonomous in their navigation, all agents are anticipated to make 
the same logic in the collision avoidance method against each other. Avoidance velocity in RVO is 
performed by averaging the value of velocity that lies outside the other agent’s velocity obstacle with the 
agent’s existing velocity. In (1), shows the RVO of agent B to agent A, which is retains every velocity of 
agent A inside the velocity obstacles in VO%(vg)averaged with the present velocity va [40]. Which the 
VOŠ (vp) itself is velocity obstacle of agents B to agent A. It includes every probable velocity that will drive 
agent A to collide with B at a particular moment in the future. 


RVOR (vg, va) = {v'4|2v'4 — va E VOS(vg)} (1) 


Where; RVO4=reciprocal velocity obstacles of agent B to agent A 

VO4=velocity obstacles of agent B to agent A 

va=current velocity of agent A 

Vg=current velocity of agent B 

Our method involved the assumption that the Brownian-based dynamic obstacles have no awareness 

at all, thus the avoidance effort lies on behalf of the mobile agents. We treat all obstacles as absolute priority 
agents while the mobile agents’ priority shared the same level of assigned value below the obstacles. The 
combined collision cones for an agent is equal to the union of RVO generated from avoidance against 
dynamic obstacles and other mobile agents. Our method distinction from the original RVO concept is in the 
combined reciprocal velocity obstacles whereas the original concept differentiates VO generated from the 
agent and obstacles [40]. In (2) shows the combined RVO’ for agent Aj in out method. The velocities inside 
the collision cone are velocities that can produce collision in the future if the agents take those velocities. 
Every mobile agent’s preferred velocities are set to the value that will guide them toward an evacuation point. 
The preferred speed in the direction of the target location is set uniformly at 3.7 unit per second based on the 
observed human speed [41]. In every cycle of motion planning, each agent’s velocities may change due to 
evasive maneuvers against obstacles and other mobile agents. Ideally, the best velocity to take is veS as 
long as the preferred velocities do not produce collisions. If the v? ref is inside the collision cone in which is 
predicted to produce collision, the agent takes the closest valid velocity that is outside of the combined RVO 


for that agent. 
RVO! = Uji RVO} (vj, vu af) (2) 


Where; RVOt=combined reciprocal velocity obstacles agent Ai 
RVO;=reciprocal velocity obstacles of other agent or obstacles to agent Ai 


v;=current velocity of agent Ai 


vj =current velocity of other agent or obstacles 


aj=effort of avoidance of agent Ai in avoiding others 

The environment which the mobile agents navigate may become dense with other mobile agents and 
dynamic obstacles. This create such a situation where the entire velocities of an agent can take become 
impossible to be admissible as it’s predicted to cause a collision in the future. Based on the expected time to 
collision, we allow agents to take velocities inside the RVO! with a certain penalty. The velocity chosen if 
such condition happens is the velocity with minimal penalty among the velocities in Avi, thus the new 
velocities v'i for agent A; is the velocity with lowest probable collision. The penalty value is given with (3). 
As the expected time to collision goes higher, the penalty value goes lower thus the velocities with the 
longest time to collision that is foreseen from certain dynamic obstacles or other mobile agents will be 
chosen. This creates more urgency to avoid the further immediate collision that will befall the agent. The 
lowest possible penalty value is at zero which is attained if the expected time to collision reaches infinite in 
which happens when no collision will transpire as there is no hindrance that causes it. The velocities, as well 
as the penalty value, are taken into account that the presence of the agents and dynamic obstacles in the 
neighboring region. This takes account due to the fact that the presence of other mobile agents and dynamic 
obstacles that are considerably distant from the agent’s current position is not enough to contribute as a 
hindrance to the agent’s navigation. We define the neighboring region around the current position of agents 
Aj with the radius of the region three times the agent’s A; radius. 
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Our Brownian based obstacles is build upon the fractal Brownian motion function [42], [43]. The 
mobile agents used in our experiment are presented in a circular shape as it is the optimal shape for mobile 
agents [40]. However, as shown in Figure 1, our dynamic obstacles vary in shape thus we opt for another 
method for shape approximation against dynamic obstacles. We use medial axis transform approximation [44] to 
approximate the shape of the dynamic obstacles. As mentioned before, the mobile agents take a complete 
effort in the avoidance process when dealing with obstacles. Figure 2 shows the various avoidance by mobile 
agents. Figure 2(a) is avoidance taken between mobile agents against an obstacle. Avoidance between mobile 
agents will result in mutual avoidance as shown with the line trace shown on Figure 2(b). When facing 
against the obstacle, the red line trace produced by a moving obstacle that translates in the opposite direction 
of the mobile agent shows no course alteration as shown in Figure 2(a), while the agent line trace shown by 
blue trace shows the evasive maneuver it takes to avoid the obstacles as shown in Figure 2(b). 


1 
tci (vr;) 


ae = v' ||| (3) 


penalty(v';) = + |v 
Where; penalty(v’;)=penalty value for velocity v'i 
tc,(v';) =expected time to collision for velocity v’; 
pr 


ef : g 
vi  =preference velocity of agent Ai 


v’,=velocity candidate to be chosen for agent Ai avoidance 


Figure 1. Dynamic obstacles with various shape and size 


(a) (b) 


Figure 2. Avoidance between various agents (a) avoidance between mobile agent against an obstacle and (b) 
avoidance between mobile agents 


3. RESULTS AND DISCUSSION 

We tested our proposed method with an evacuation scenario in the environment shown in Figure 3. 
All mobile agents start at the area labeled A in Figure 3 and are tasked to navigate toward the evacuation area 
shown with label B. In the middle of the navigation plane, we put a massive amount of Brownian-based 
dynamic obstacles with varying sizes, shapes, and parameters. Figure 1 shows the dynamic obstacles that 
appeared in our experiment with shapes that vary to circle, cube, and long cube shape, also three different 
sizes. We conducted this scenario from total agents from 100 to 1000 with our proposed method and the 
original RVO method as a comparison. In Figure 4, we demonstrate 500 mobile agents with our 
implementation of our proposed method. The agents moving through scattered dynamic obstacles. The result 
shown in Figure 5 and detailed result in Table 1 give us information of collision occurred in our 
experimentation. The majority of collision is caused by agents’ collision toward obstacles as it is the most 
challenging maneuver due to the fact that the Brownian-based dynamic obstacles behave unpredictably 
unlike agents to agent avoidance. 
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Figure 4. 500 mobile agents moving through scattered brownian based dynamic obtacles 


Our proposed method is shown to produce better maneuver, it’s caused 46.09% less collision in 
average compared to the original RVO method as shown in graphics on Figure 5(a). However there are 
several drawbacks as shown in Figure 5(b). Our method caused mobile agents’ collisions against each other 
to occur more often. Our approach to treating all obstacles as absolute priority agents caused the velocity 
obstacles produced by Brownian-based dynamic obstacles to have a higher penalty value. This is further 
reinforced by another agent’s direction that shares the general direction toward the evacuation point of area B 
in our navigation space. This situation creates more reason for agents to bump at each other when evacuating. 
The obstacles may approach agents in the opposite direction of agents’ evacuation point, therefore creating 
more immediate collision compared to other agents that navigate in the same direction. This collision event 
happens infrequently as opposed to collision against obstacles, which in turn generated the overall collision 
shown in Figure 5(c) that indicates that our proposed method produces a safer outcome. 

While our method can produce safer navigation as indicated by collision occurrence, the average 
time to reach destination shown in Figure 5(d) annunciates less efficient navigation. The time required for the 
agents to arrive at the evacuation point increased by an average of 1.33 seconds. We perceive this as an 
important matter for navigation in general, especially in an evacuation scenario. As stated by Godoy et al. [45], 
many studies forget about efficient navigation while achieving safe navigation. Our findings will be further 
investigated in future studies to improve efficiency while still paying attention to navigation safety. 
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Mobile Agents Collision Against Obstacles 


Mobile Agents Collision Against Each Other 


(b) 


Overall Collision 


Time to Reach the Destination 


Figure 5. Result of experiment in graph (a) mobile agents collisions against obstacles (b) mobile agents 
collisions against each other (c) overall collisions of every agents, and (d) time to reach the destination 
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Table 1. Result of experiment 


Brownian motion based dynamic obstacles as agents Generic Brownian motion based dynamic obstacles 
Mobile Mobile : 2 Mobile Average 
Number i : Average time Mobile agents g i : 
of Total of age nts i age nts : to reach Total of collisions age nis . nme 
agents collisions collisions collisions destination collisions against collisions to reach 
against against g ; i g against destination 
obstacles each other (seconds) obştacles each other (seconds) 
100 33 25 8 18.56 150 149 1 17.57 
200 62 45 17 19.76 267 262 5 18.04 
300 105 80 25 21.16 393 284 9 19.66 
400 207 169 38 21.40 570 553 17 19.97 
500 433 380 53 22.15 859 814 45 19.84 
600 757 682 75 22.69 1227 1150 77 21.04 
700 1126 969 157 22.47 1727 1591 136 22.03 
800 1541 1283 258 23.48 1991 1840 151 22.39 
900 1643 1352 291 23.31 2246 2110 136 21.93 
1000 1797 1478 319 23.19 2398 2190 208 22.40 
4. CONCLUSION 


Our proposed method was able to improve agents’ avoidance maneuver against obstacles that 


dynamically shift based on Brownian motion. Using the approach of treating all obstacles as absolute priority 


age 


nts caused mobile agents’collision against obstacles to lessen on average by 46.09%. The overall collision 


that occurred in our experimentation show 51.1% less collision which is denote safer navigation for agents in 
approaching their evacuation point. However, the average time to reach the destination is increased by an 
average of 1.33 seconds. Our further study will focus on generating efficient navigation, which is not only 
secure in regard to the collision but also generates faster time to reach the evacuation point. 
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